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Abstract — We derive a hybrid feedback control law for the 
lateral leg spring (LLS) model so that the center of mass of a 
legged runner follows a curved path in horizontal plane. The 
control law enables the runner to change the placement and the 
elasticity of its legs to move in a desired direction. Stable motion 
along a curved path is achieved using curvature, bearing and 
relative distance between the runner and the curve as feedback. 
Constraints on leg parameters determine the class of curves that 
can be followed. We also derive an optimal control law that 
stabilizes the orientation of the runner's body relative to the 
velocity of the runner's center of mass. 



I. Introduction 

From tiny ants to large elephants, legged locomotion is 
the dominant method that animals use to move on the 
ground. Although the leg structures are vastly different across 
species, the mechanisms for walking, jumping or running obey 
strikingly similar principles. These similarities are captured 
by mathematical models such as the spring-loaded inverted 
pendulum (SLIP) model, see [1], and the lateral leg spring 
(LLS) model in [2]-[5]. The LLS model describes motion in 
the horizontal plane and the SLIP model describes motion in 
the sagittal (vertical) plane. 

We use the LLS model in this paper in designing curve 
tracking control in the horizontal plane; the runner is modeled 
as a rigid body with two weightless springs attached to a 
point in the body called the center of pressure (COP). Each 
spring represents legs on one side of the body. The COP is 
usually not coincident with the center of mass (COM). Legged 
locomotions can be self-stabilized — the running or walking 
gaits stay close to being periodic under disturbances — without 
feedback control. As indicated by a recent review [6], the self- 
stabilized walking and running happen when the runner moves 
along a straight line. 

There are many interests in engineering practice to design 
and build legged robots which are versatile on rough and 
uneven terrains. Legged robots are greatly appreciated in 
applications such as searching and rescuing missions and 
planet exploration. In most missions, the robots must be able 
to move along an arbitrary path. Feedback control is needed 
for tracking curved path as well as stabilizing the periodic 
gaits. 

In this paper, we develop feedback control law for the LLS 
model so that the COM follows a curved path. The legged 
locomotion modeled by the LLS model is a hybrid system. 



Correspondingly, the tracking control contains a discrete track- 
ing algorithm which guarantees convergence to the desired 
curve and a continuous law to control the leg parameters of 
the LLS model. We also develop an optimal control law to 
stabilize the posture of the rigid body. Section [TT] serves as an 
introduction to the LLS model. The discrete tracking algorithm 
is developed in Section [III] In Section [IVj control laws are 
developed for the leg parameters to enable the discrete tracking 
algorithm. The constraints on the parameters and the effects 
on the tracking behavior are discussed in Section [V] and a 
modified continuous control law is introduced to handle the 
constraints. We then develop an optimal control law to achieve 
desired posture for the rigid body in Section [VI] We provide 
simulation results in Section IVIII 



II. Motion of the COM 

In the horizontal plane, motion generated by the LLS model 
starts when the free end of one spring (or leg) is placed at a 
touchdown point P. At this starting moment, the spring is at 
its free length t)q. If the COM has a non-zero initial velocity 
v that is not perpendicular to the spring, then the spring will 
be first compressed to a minimum length and later be restored 
to its free length. This process, starting and ending with the 
spring at its free length 770, is called a stance phase or simply 
a stance. The COM moves from the starting position to an 
ending position after a stance. Suppose that mechanical energy 
is conserved during each stance, then the starting and ending 
speed of a stance is identical. As shown in Figure [T] the end 
of one stance serves as the beginning of the next stance with 
the touchdown point P shifted from one side to the other. This 
allows us to distinguish left stances from right stances based 
on which leg is supporting the body. 

The rigid body moves forward as a result of switching 
between left and right stances. As shown in Figure Q] we 
use Yi, i = 1,2,..., to denote the position of the COM in a 
lab fixed coordinate frame at the beginning of the zth stance. 
We use aj to denote the angle between the velocity v, and 
the spring at rest. For a right stance, the angle is measured 
counter-clockwise from the spring to the velocity vector. For 
a left stance, the angle is measured clockwise from the spring 
to the velocity vector. Under this convention for measuring 
angles, on has to be within the interval (0, 7r/2) to generate 
forward locomotion. 

We can view as points on a curve T which is formed 
by straight line segments that connects r,*_i with for all 
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Fig. 1. The LLS model for legged locomotion. One left stance followed by 
one right stance are plotted. The center of mass (COM) is translated from 
r;_i to r<. The velocities of the COM at the beginning of each stance are 
the vectors v^_i and v^. The angle between and the spring (leg) is on. 
The angle between vector q; and the horizontal axis X is <5;. The positive 
directions for all angles are as shown. 



i. This curve T is not the actual trajectory of the COM, but 
it intersects with the trajectory of the COM at the points r,. 
We then let = r^+i — and define qi = || q-j ||. We also 
define an angle <5; as the angle between the vector and the 
horizontal axis of the lab frame, measured counter-clockwise 
from the axis. This angle describes the direction of curve Y for 
the ith stance. The motion of the COM can now be described 
by a discrete system 



fi+i 



■ [qi cosJj, qi sinJj] 



(1) 



Next, we develop a boundary tracking algorithm for this 
discrete system. 

III. Tracking a detected boundary 

Suppose at the position r,, the runner is able to detect a 
segment of a boundary curve from sensor information, c.f., 
[7] and [8]. Suppose the runner is also able to estimate a 
point on the boundary curve that has the minimum distance 
to the COM. We call this point the closest point r Ci shown in 
Figure [2] By selecting two extra points on the boundary near 
r Ci , the runner can estimate the tangent vector to the boundary 
curve x Ci and the curvature of the boundary curve Ki using 
algorithms summarized in [7]. Here we suppose all estimates 
are perfect. 

We let pi represent the distance between the COM at r\; and 
the closest point at r Ci . We also let 

x » = 71 ii ( 2 ) 



be the unit vector in the direction of q^. We can then define 
two right handed frames — one at and the other at r Ci — by 



Pm r 




pi y 




Fig. 2. The movement of the COM near a boundary curve. Qi is the angle 
between en and x Ci . pi is the distance between the COM and the closest 
point. Ki is the curvature of the curve. 7; is the center angle of the arc 
connecting r Ci and r Ci+1 



defining two unit normal vectors and y Ci as shown in Figure 
|2] The angle 9i between Xj and x C; is defined by letting 



COS t 



= Xj • x Ci and sinf^ = — Xj • y c 



(3) 



In Figure [2] the closest point on the boundary moves from 
r Ci to r Ci+1 during a stance. We then assume that each stance 
is short enough so that the curvature of the boundary curve 
detected during this period can be approximated by a finite 
constant Ki, From Figure [2] we observe 
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Therefore, according to the cosine law, we have 

(P 



l + — ) 2 = Oi + — ) 2 - 2(pi + —)qi sin Oi + qj 

Ki 



(4) 



(5) 



We can view pi as state variables and consider as the 
control over step size and 9{ as steering control. Equation (0) 
describes the controlled relative motion between the COM and 
the detected boundary curve. 

Suppose that the step size has been determined. We need 
to find Oi such that pi converges to a desired value p c as 
i — ► co. If we can find a feedback control law /j(-) such that 

Pi+i- Pi = fi(pi- pc), (6) 

then we can choose the function /j(-) so that pi — p c — > 0. 
For example, we may let 

fi(pi - p c ) = -Ki ■ (pi - p c ) (7) 

where < Ki < 1. Observe that 

Pi+i - Pi = pi+i - Pc - (Pi - Pc), (8) 
and this leads to 

p l+ i - p c = (1 - Ki)(pi - p c ). (9) 
Since — 1 < 1 — Ki < 1, it is true that pi — > p c as i — > oo. 
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We now define A^ = p, + — . In order to achieve (|5}, we 
replace (pi+i + ^-) with (Ai + /;) in ©. From (0, we can 
solve for sin B. L as 

sin 6»j - — 

2Ai5j 

— Si _ _ _ li (io) 

2Aj qi 2Xiqi 

When fi = 0, the solution is 9i = sin (gj/2Aj). This 
corresponds to the runner running parallel to the boundary 
curve. 

Note that when Ki — > 0, then A^ — > oo. The limit of equation 
([TOll is 

fi 



sinf, = 

3» 



(11) 



which is equivalent to pi + i — pi = —qiSm8i. This equation 
indeed describes the relative motion between the COM and 
a straight line. Therefore, all the results that will be obtained 
from JTQl are applicable to (fTTT i by letting Aj — ► oo. 

Lemma 3.1: A solution exists for 9i in equation (fTOl if 
and only if /, e [-(2A< + g,), min{-?i, g^ - 2AJ] or f e 
[ma,x{-qi,qi - 2A i },g i ]. 

Proof: A solution exists for 9i if and only if 

-ff-2XJ t + qf 



and 



2Xiqi 

■f[ - 2Xjfi + qj 
2A,gi 



< 1 



> -1. 



(12) 



(13) 



From (fT2l we have, 

/? + 2Xifi - (g? - 2X iqi ) > (14) 

which is equivalent to 

{fi + (2X i -q i ))(f i + q i )>0. (15) 

This inequality is satisfied if and only if 

fi > max{-<7i, qi - 2AJ or / 4 < min{— g,, qi - 2A 4 }. (16) 

From ([T3l we have, 

fi + 2Aj/i - (g? + 2A 4 g t ) < (17) 

which is equivalent to 

{fi + (2X i + qi))(f i -q i )<0. (18) 

This inequality is satisfied if and only if 

- (2Ai + qi ) < fi < qi. (19) 

Therefore, combining ( TToT l and (fT9l . we have found the neces- 
sary and sufficient condition for the existence of solution for 

0i as 

- (2A 4 + qi ) <f,< min{- qi , Ql - 2AJ (20) 



or 



max{-gi, q { - 2AJ < f < qi. 



(21) 



Lemma 3.2: Suppose < qi < 2A^. Let fi = —Ki(pi—p c ). 
There exists Ki G (0, 2) such that (l2~Tl i is satisfied and Qi in 
([Tol l has a solution. 

Proof: If |pj — p c \ < imin{gi,2Ai — g.;}, we may let 
Ki be any value in the interval (0, 2) and d2TI > is satisfied. If 
I Pi ~ Pc\ > I min{gi, 2Aj - gj, we may let 



< Ki < min{2, • 



2A, ; 



Qi 



} 



(22) 



IP< — Pc| \Pi-pc 

which satisfies (|2~T] |. ■ 
The condition g^ < 2Ai in Lemma 13.21 indicates that each 
step size should not be too big. If the curve has large curvature 
i.e. small turning radius, then the runner must reduce its step 
size when being close to the curve. For a straight line, since 
Xi is arbitrarily large, there is no constraints on the step size 

g». 

Theorem 3.3: Suppose the step size g^ satisfy < g, < 2Aj. 
Let fi = —Ki{pi - p c ). Select K £ (0,2) such that 9i in 
(fTOl has a solution. Then under the control g^ and 9i, we have 
Pi —* pc as i — > oo. 

Proof: Under the selection of qi, fi and Ki, we have 

p i+ i - p c = (1 - Ki)(pi - p c ) (23) 

for all i. Since — 1 < 1 — Ki < 1, the convergence is proved. 

■ 

Once 9i is determined from ( [Tol l, we can compute the 
direction of in the lab frame. This is because 



(24) 



where Q is the angle between the horizontal axis of the lab 
frame and the vector x Ci , measured counter clockwise from 
the horizontal axis. Knowing qi and Si allows us to compute 
the position of the COM for the next stance from the discrete 
system given by equation (D. 

IV. Control the LLS model 

In order to generate desired qi and Si to control the COM 
movement, the runner needs to change its leg placements or 
the elasticity of the legs. We investigate the dynamics during 
each stance to establish the relations between the COM motion 
and the leg parameters. 

Leg parameters for a right stance and a left stance often 
differ only by the sign. Since a right stance is always followed 
by a left stance and vice versa, we use the convention that the 
stance k is always a right stance and stance k + 1 is always 
a left stance. Therefore, stance k + 2 must be a right stance, 
etc. In the following, we will only show detailed derivation for 
a right stance; similar results for a left stance will be listed 
directly. 

We set up a polar coordinate system at the touchdown point 
Pfe with the horizontal x-axis parallel to the horizontal X-axis 
of the fixed lab frame. Let (77, ijj) be the polar coordinates of 
the COM in this frame and let a describe the orientation of 
the rigid body. Then the total energy is 



E 



1 



1 



1 



mf] H — mrj ip H — la + V(rj) 



(25) 
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where we assume the spring has potential energy V which 
depends only on its length. 

During each stance, the dynamics can be described as 
a continuous nonlinear Hamiltonian system; the Hamilton 
equations are developed in [2]. The system is not integrable 
when the distance between the COM and the COP is nonzero. 
In this case numerical methods are necessary to compute the 
trajectory of the COM from knowledge of the states (77, ip, a). 

To illustrate analytical insights for the tracking problem, 
it is much easier to study the case when the COP and 
COM coincide. This is because the corresponding system is 
integrable. The Hamilton equations for the dynamics of the 
COM are 

p v — mfj 
Pip = mr) 2 ip 

1 2 9V 
mrf ' or/ 
Pi, = 0. (26) 




Fig. 3. The LLS model with COM coincide with COP. Angle cf> k is the center 
angle swept during the stance. Angle a k is the angle between the leg and the 
velocity at the moment of touch down. 

We plot one right stance in Figure [3] Let be the velocity 
of the COM at the beginning of the fcth stance. This 
provides initial value for the states p v and p^ of the system 
(1261 . Because mechanical energy is conserved, the speed 
Vk = || Vfc || satisfies Vk+i — vt- We let aj. represent the angle 
measured from the leg to the velocity v,t at the moment of 
touchdown, and we call a/, the leg placement parameter. We 
use ipk to measure the direction of velocity in the lab frame. 
By using simple geometric relationships in Figure [3] we have 

K fa 

- - — - otk = dfc - tpk. (27) 
Therefore, using equation ( f24b . 

Cfc - <Pk - Ok = 2 _ a k ~ y (28) 



Note that — (ff.) is the relative angle between vj. and x Cfc : 
the tangent vector to the boundary curve at the closest point. 
We know 9 k is the angle between vector and the same 
tangent vector x Cfc . Therefore, — ip k — Ok) is the angle 
between and q^. From d28l . we see that changing ak will 
change the direction of the COM movement q^. This is also 
true for a left stance where we have 

Cfc+i - <Pk+i - = -(^ - a k+1 - ^yi). (29) 
Another relationship we can derive from Figure [3] is 

q k = 2rj k sin ^ (30) 

where r\% represents the leg length at the moment of touch- 
down. 

In ( f30b and d28| i, q% is the distance the runner wants to 
travel in one stance, the angle 9k can be solved from dTOb . and 
the angle ((k — <fk) is known. We want to solve for the leg 
parameters and r)f-, but <\> k is still unknown. This unknown 
can be solved from the continuous system equations d26| ). 

At the starting position of the kth stance and the ending 
position of the fcth stance r^+i, by conservation of the angular 
momentum, we have 

Pvk+i = Pvk = Vk^ = VkVk sma k - (31) 

Using the method of integration by quadrature, c.f. [9], we 
can compute the center swing angle fa for each stance as 

fa = 2 / \ =dy (32) 

J ^ ± y j2E-^-2V(r ] ) 

where ?7 m i n is the shortest length of the spring during the 
stance. When r\ = r; m i n , we have t) = 0. Thus we can solve 
Vmin from 

2E 2V{i lmin ) = . (33) 

^min 

Explicit formulas can be derived for fa when we use the linear 
spring potential V = bk(ij — r/k) 2 where bk is the spring 
constant for the fcth stance. These formulas require the use 
of elliptic functions [2]. 

Since fa is now a known function of ak, rjk, and bk, we can 
solve for any two of ak, i]k, and bk from ( 1281 and (1301 when 
keeping the other parameter constant. For a runner, controlling 
ak means to find the appropriate angle between its leg and the 
direction of the COM motion. On the other hand, as reported 
by Jindrich and Full in [10], the cockroaches control the length 
j]k by stretching or compressing their legs when turning. We 
see that changing r)k will affect both p^ k and V(rf). This 
changes fa and hence controls ~tp k — Q k ). Another means 
of steering is to change the potential energy V{rj) ,e.g., change 
the spring constant bk, which also controls fa. 

If the conditions in Theorem 13. 3 1 are satisfied, equation (TlOb 
always has a solution for #j. The equations d28l . (l30l and (1321 
can be solved to implement the control 9i. We call this method 
the inverse method. Note that finding solutions for ak and r\k 
often requires numerical methods because fa is not a simple 
function of ak and rjk. 
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V. Tracking Behavior Under Constraints 

For every stance, the LLS model generates the COM 
movement q^ by controlling parameters such as ctk, r\k and 
bk- In practice, these parameters all have to be bounded. 
These bounds post constraints on the possible qfe that can 
be generated by the LLS model. In this section, we first 
discuss the constrained COM movement and investigate the 
constrained tracking behavior when a runner is running along 
a curve path. We then derive a new control law with proved 
convergence under the constraints. 

A. the constraints 

To generate forward locomotion, the relative angle at 
between the leg and the COM velocity v& should be bounded 
within the interval (0, 7r/2). Figure [4] illustrates the possible 
q^. that can be produced by changing for a right stance 
when rjk and bk are held constant. The parameters for the 
plotted LLS model are m = 2.5g, Vk — 0.2m/s, rjk = 1.7cm 
and bk = 1.05N/m which are typical for a cockroach. When 
ctk = and ctk = 7r/2, we have qk = 0. Therefore, in order 
to move forward effectively, the angle ctk must be within an 
interval [aw, a max ] with a min > and a max < ir/2. The 
solid segment in Figure [4] illustrates the possible between 
(*min = 7r/6 and a max = tt/3. We also plot the length qk as 
a function of the leg placement angle in Figure [5] There 
the maximum q^ is 1.44cm. When ctk is within [tt/6,tt/3], 
the minimum is 1.24cm. The changes in q^ is not big for 
a wide range of This is typical for LLS models. 
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Fig. 4. The possible generated by a right stance for an LLS model, 
is the velocity of the COM. The units are in meters. The curve (dotted and 
solid) illustrates the end points for vector qj, starting from the origin when 
otk changes from to 7r/2 while other parameters are constant. The solid 
segment corresponds to £ [71-/6, 7r/3]. 

The above example suggests that it is possible to keep -qk, 
qk and <fik constant for each stance. We control the spring 
constant bk and the leg placement angle ctk- The advantage 
of this strategy is that the distance traveled by the COM is 
identical for every stance. This fact can help us analyze the 
tracking behavior later. For the LLS model plotted in Figure 
2] and [5] in order to keep q^ = 1.44cm, we plot the spring 
constant bk as a function of the leg placement angle ctk in 



0.015 



0.01 




0.2 0.4 0.6 0.8 1 1.2 1.4 1.6 

Fig. 5. The length gj- (in meters) traveled by the COM during a right stance 
for an LLS model as a function of leg placement angle (in radians). The 
solid segment corresponds to aj, £ [7r/6,7r/3]. 

1.2 1 1 1 1 1 1 1 1 

1.1 - 




0.5 - / 
/ 

/ 

0.4 - / 
/ 

/ 

0.3 - / 

0.2 1 1 1 1 1 1 1 

0.2 0.4 0.6 0.8 1 1.2 1.4 

Fig. 6. The spring constant (in N/m) as a function of leg placement 
angle (in radians) to keep = 1.44 cm. The solid segment corresponds 
to ctk £ [7r/6, 7r/3]. 

Figure[6] For ctk 6 [7r/6,7r/3], bk lies between 0.78N/m and 
1.06 N/m. This range is not difficult to implement. 

With qk constant for each stance, the possible movement of 
the COM can be depicted by a cone Ck ■ The two edges of the 
cone correspond to ctk = »min an d a k = awx- The length 
of both edges are qk . Figure [7] illustrates cone Ck+i and cone 
Ck- Ck+i grows from the end point of q^ which lies in the 
circular arc of Ck- We found that Ck+i is the mirror image of 
Ck with q/j being the axis of symmetry. This is because the 
velocity vector v^+i and are symmetric with respect to q^,, 
which can be proved by solving equations d26T ). Therefore, as 
the runner moves forward, the cone will flip from side to side. 

B. running along a curve path and robustness 

We use the index i for all right and left stances. When 
running parallel to a desired curved path, the COM movement 
satisfies pi — p c for all i. Therefore, we have /, = in 
equation HOi . The following conditions are necessary: 

Al) q» S Ci, 

A2) e i = shr 1 (q i /2X i ). 
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Fig. 7. The cones flip from one side to another when running. On the left, 
the cones and Ck+i are symmetric with respect to which is the solid 
arrow. In the middle, the runner is running along a straight line. On the right, 
the runner is running along a curve path in the counter clockwise direction. 

Condition Al requires that the COM movement belongs to the 
cone that is feasible for the constrained model. Condition A2 
requires that q; is parallel to the desired curve. 




Fig. 8. The sub-cones and CjP +1 - is the middle line of C£, and 
<ik+i is the middle line of CjjS The angle difference between q^+i and qj. 
is 7. 

If the desired curve is a straight line segment, then ftj = 
in condition A2. As the runner moving forward, the cone d 
will be flipping side to side with respect to the straight line. In 
this case we have on, = ai+%. The robustness of this behavior 
is determined by the size of the cone and the value of a,. If 
we choose the value of on so that the COM movement is 
always in the middle of the cone, then the tracking behavior 
is the most robust. See the middle figure in Figure [7] 

If the desired curve is convex with positive curvature, then 
9i 7^ 0. To find out i7 we study the fcth and (fc + l)th stance, 
i.e., a right stance followed by a left stance. For convenience 
we let 

7fc = 2sm- 1 ^. (34) 

From equation (|73l in Appendix U and using the fact that (j)f. = 
<fik+i> we know that 9^ and 8f.+i satisfies 

#fc+i - &k = -{otk+i ~ a k ) + Ik- (35) 

This relation can also be observed from Figure [2] Condition 
A2 implies that 9 k +i = &k = 7fe/2. Therefore, when running 



along a convex curve, a/c+i — &k = Ik should be satisfied. 
We have similar relation for stance k + 1 and k + 2, i.e., a left 
stance followed by a right stance: a k +2 — oik+i = —Jk+i- We 
can then write o,+i — on — ±7.; for all stances. This equation 
requires that 7* must be less than (a max — a m i n ). This implies 
that Aj, the instantaneous radius of the curve must satisfy 



This condition is stricter than A; > qi/2 required by Lemma 
13.21 Hence the constraint on on puts a tighter restriction on 
the curvature of the curve that can be traced. 

We divide Cj into two sub-cones. Let Cf be the cone for 
a £ [a min , a max - 7*]. Let Cf be the cone for a £ [a min + 
7ij CKmax]- Because C,; flips and ct!j+i — on = ±7,;, if q^ belongs 
to Cf, then q^ + i belongs to Cf +1 . Now consider a right stance 
k followed by a left stance (k + 1). When running along a 
convex curve in the counter clockwise (CCW) direction, the 
runner must have ctk £ and a k +i £ see F r igure [8] 

When running in the clockwise (CW) direction, the runner 
must have ctk £ and a k +i £ C£ +1 . 

To increase the robustness of the tracking behavior, we 
should let the COM movement q^ be close to the middle of 
Ci. In the case of convex curves, the best choice is to let q; 
and q,-_|_i be symmetric with respect to the middle line of Ci. 
The middle lines of C^ and Cf are symmetric with respect 
to the middle line of Ci. The angle between the middle lines 
of Cj A and Cf is 7,. If the curve has constant curvature, then 
7i is constant for all i. This implies that the middle lines of 
Cf' and Cf +1 are symmetric with respect to the middle line 
of Ci. Therefore, we may choose q^ to be the middle line 
of either Cf or Cf for maximum robustness. If the curve 
has a changing positive curvature, then 7; can be different 
from stance to stance. This "middle line" strategy can not be 
enforced. In this case one can choose q^ to be as close to the 
middle lines as possible. 

If the desired curve is not convex, the tracking behavior 
can be viewed as switching between tracking a locally convex 
curve in the CCW direction and in the CW direction. The 
switching depends on how the curve changes from locally 
convex to locally concave. No general conclusions can be 
drawn regarding which part of the cone Ci is used for a stance. 
In this case the tracking behavior is not a "steady state" . 

C. The approximation method 

The inverse method fails when constrained solutions from 
d28b . ( f30b and d32l do not exist. We design a new control law 
that is able to find leg parameters that satisfies all constraints. 
The control law also guarantees convergence to the desired 
curve from generic initial conditions. We call this method the 
approximation method. 

We investigate the LLS model satisfying = q for all i 
where q is a positive constant. To keep = q, the runner 
controls both the leg placement angle on and the spring 
parameter 6;. We assume that the desired curve path is either 
a straight line or a circle i.e. K{ is constantly k for all i. 
This assumption can be relaxed to convex curves with slowly 
varying curvature. We further assume that the step size q is 
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much smaller than the radius of the curve path. Under these 
assumptions, pi + i — pi <C 2(pi + -), and equation (fTOb can 
be simplified to 



Pi+i - p c — Pi - Pc + 7^ q sin 6i 



(37) 



where Aj = (pi + -). We then view sin^ as the second state 
variable other than pi — p c . It satisfies 



sin^ = sin ( Q - ipi =p (- - a, - — 



(38) 



when all the angles are mapped to the interval (— tt/2, 7r/2). 
We can apply the backstepping technique for discrete systems 
c.f. [11] to the system described by ( f37b and d38l . 

Let /j = ~Ki(pi ~ p c ). According to Theorem 13.31 we 
can select Ki such that ( fTOb can be solved for We let this 
solution be 0; i.e. 



sm( 



-ff ~ 2AJ, 



2A,g 

q fi f? 



2Ai g 2A 4 g 



(39) 



Using the fact that 



we have 



fi = (Pi+i - Pi) « 2(p 4 + -) = 2A, 

K 



q sin 0i = — - / t 



Note that 0j is different from the state variable di in (|37T i and 
(l38l . Here 0j is a function of pi and can be viewed as the 
desired value for the state 9i. 

2 

We can then solve for the term from CI41D and substitute 
this term in the right hand side of (f3Tb . This yields 

Pi+i - Pc = Pi - Pc + fi - <?(sin 9i - sin §i). (42) 

We define 

Pi+i = Pi - Pc + fi = (1 - Ki)(pi - p c ). (43) 

This pi+x can be viewed as the desired value for the state 
pi + i — p c - With the help of 9i and f>i+i, we rewrite (l42l as 



p i+ i - p c - Pi+x = -q(sm9i - sin 6^). 



(44) 



We design on as a feedback law so that the right hand side 
of (l38l satisfies 



sin [ C; - Vi T (-g _ a i - y ) I sm ' 



Ki 
q 



(Pi 



-pi) 

(45) 



where Ki is a scalar which will be determined later. Thus 
becomes 

K 

sin9i - sin 9i = —(pi- p c - pi). (46) 

We show that the closed loop system given by d44i i and (PES! 
converges to the state where 9i = 9i and pi = p c . 

Lemma 5.1: Consider the system given by d37| ) and d38l . 
Let Ki and K l be such that II - KA < 1 and 1^1 < 1. 



Suppose ( l45T l has a solution for Qj. Then as i — > oo, we must 
have 0j — > 6*j and — > p c . 

Proq/;- If (|43T l has a solution for c^, then (l44l and d46l ) 
hold. Therefore 



sin t^i 



i - sinflj = —Ki(sin9i-i 



- sin^-i) 



(47) 



Since \Ki\ < 1, it is true that sin#i — sinflj — > as i — > oo. 
Meanwhile, from d44l . we conclude pj_|_i — p c — — > as 
i — > oo. This implies that p^+i — p c — > (1 — Ki)(pi — p c ). 
Since |1 — JQ| < 1, we conclude p,; — > p c as i — » oo. ■ 
If we allow \Ki\ to be arbitrary large then d45l > always has 
solutions for ai. By selecting proper value for Ki, we can 
find a solution that satisfies the constraints for a,-. However, 
Lemma 15.11 requires that \Ki\ < 1 to achieve asymptotic 
convergence. We want to find out when ( |45T > fails to have 
a solution for as if \Ks\ < 1. 



If we can find ai G \a 



mm i ( 11 max 



such that sin ( 



sin f j 



I i. Then we can let Ki = and a solution for a, exists. This 
is exactly the inverse method. 

If we can not find a constrained a,; such that sin 0$ —sin = 
0, then let 



Mi = min {| sinflj - sin0j|}. (48) 

Qi^[Qmiii,Qmax] 



(40) We let 



M iq 



Pi - Pc - Pi 



(41) If 



\pi - Pc - Pi\ > Miq 



(49) 



(50) 



is true, then \Ki\ < 1. Equation d45l l becomes sin 0, — sin ^ = 
Mi, and a solution for ai can be found. Therefore, when a 
solution for ai can not be found for Ki given in j49l , we 
must have 

Ipi-pb-ftl <Mig. (51) 

We argue that this implies that the distance between the runner 
and the desired path becomes sufficiently small as i — » oo. 

We define M — sup i Mi. Since \ sin 9i — sinful < 2 
regardless of the value of 9i and 9i, it is true that M < 2. 
The following theorem claims that the controlled movement 
of the COM converges to a small neighborhood of the desired 
curve. 

Theorem 5.2: Consider the system given by (|37T > and (f38t 
controlled by the approximation method. Suppose the gain Ki 
is constantly K for all i and |1 — K\ < 1. We determine the 
value for leg placement angle a, by solving d45l >. For every i, 
we let Ki be given by j49l . Then we must have lim^oc, — 
p c | <Mq/(l -\l-K\). 

Proof: If \Ki\ < 1 for all i, Lemma IBTTI claims that the 
system converges to pi = p c . Then lim^oo \pi — p c \ = < 
Mq/(l-\l-K\). 

If for some time indices j, \Kj\ > 1, then condition (IBTt 
must be true. We must have 

I ft ~ Pc - ft I < < -^9 ( 52 ) 
This implies that 

Ift - Pel < |1 - K | ■ \ Pj -! - pc| + Mg. (53) 



x 



For the rest of time indices i where \Ki\ < 1, equation ( l44l 
implies that 

\Pi~Pc\ < |1 -K\ ■ \pi-x -p c \ + | sin^i_i -wa.0i-i\q (54) 

Since Ki-i is given by d49l i. We must have sin 6^-1 — 
sin^-il = Mj-i. This implies that d53l l is satisfied for indices 
i. Therefore d5"3l l is satisfied for all i and j. Because |1— K\ < 
1, we conclude that limj_,oo \pi — p c \ < Mq/(1 — |1 — i4f|). 

■ 

Remark 5.3: From Theorem 15.21 we conclude that larger 
step size (bigger q) and faster convergence rate in relative 
distance (bigger K) may cause larger tracking error. This 
agrees with intuition. The Theorem is conservative because 
we can make Ki adaptive. When \pi — p c \ small, we can let 
Ki to be close to 1 to reduce the possible tracking error. Also, 
M does not have to be the supremum of Mj for all i. Instead, 
we can let i be larger than any finite time. This may reduce 
M . Another observation is that by increasing a max — a min , 
we can reduce M, hence reduce the tracking error. This also 
agrees with intuition. 

Remark 5.4: Equation ( |48T > is used to compute a* that 
minimizes the difference between 6% and 0*. This is why the 
method is called the approximation method. Such a method 
can be devised heuristically without applying the backstepping 
technique. But the backstepping technique helps to justify 
convergence. One can also derive other convergent method 
which have different performance than the current one. But 
from the proof of Lemma 15.11 we conclude that the approx- 
imation method gives the fastest convergence rate among all 
such methods derived from the backstepping procedure. 

VI. Controlled Rigid Body Dynamics 

Unlike stable running along a straight line, the rigid body 
angular momentum p a should not be zero for stable running 
along a curve; otherwise no turning can happen. Since our 
goal is to control the runner to the desired curve, even if the 
final stable running is along a straight line, the runner need 
to turn in order to move to that line from an arbitrary initial 
position. The LLS model dynamics for the rigid body is 

Pa = I& 

Per = T (55) 

where r represents the torque to produce turning for the 
rigid body. Runners can produce this torque by using muscles 
connecting legs and body or by changing force distribution 
over multiple legs. 

As indicated in Figure [9] the angle between the body axis 
and the velocity of the COM is (cr^ — (pp.). For stable running, 
we want to achieve the following gaits: after the fcth stance, 
the ending angle (<r k+ i — <fk+i) differs from the starting (<7& — 
ifk) only by the sign; accordingly, the direction of the angular 
momentum will be reversed ,i.e., p ak+1 = —Pa k - 

This stable running requires that as k — > oo, 

<Jk-fk -> C x and p ak -> C 2 (56) 
for right stances and 

o-fc+i - ifik+i -> -Ci and p ak+1 -> -C 2 (57) 




Fig. 9. The posture of the rigid body at the beginning and the end of a 
stance. 

for left stances where C% and C2 are pre-selected constants. 
For right stances, we let 

o-fc+i - ipk+i + C\ = (1 - K 4 )(a k -(Pk-Ci) 
P* k+1 +C 2 = (l-K 5 )( PcTk -C 2 ) (58) 

where < if 4, K5 < 1. For left stances, we may let 

Cfc+2 - <Pk+2 - Cy = (1 — K i )(ak+1 - <Pk+l + C\) 

Pa k+2 - C 3 = (1 - K 5 )( Pak+1 + C 2 ). (59) 

Note that tp k and ipk+i are known from d66l i and (|67| | in 
Appendix Q] It is not difficult to see that the discrete systems 
(|58] > and (l59l achieve the desired convergence specified by 
<|56) and (E). 

Therefore, for the fcth stance, we want to design the control 
torque r so that starting from p Gk and a k , the runner will 
reach the state p<j k+1 and ak+i given by 

Pa k+1 = (1 - K 5 )p ak + (2 - K 5 )C 2 
a k +i = (1 - K A )(T k + K A ip k + 

7r-(t> k -2a k + (2-K i )C 1 . (60) 

We formulate an optimal control problem with the start- 
ing state given by (p ak , a k ) and ending state given by 
(Po-fc+i ) <J k+i) in equation (l60b . The ending state should be 
achieved within the duration T k for the fcth stance with the 
cost function T 2 {t)dt minimized. The solution for Tk(t) 
for the fcth stance can be obtained by applying the maximum 
principle. We have 

T k (t) = \{A 2k - ^t) (61) 

where t 6 [0, Tk], I is the moment of inertia, and 

24/ 2 121 
A U = -fri^k+l -o"fe) - -ju(p<r k+ i +Pcr h ) 

12 J , s 4 8 

A 2k = ^-(CTfe+i - cr fe ) - — p ak+1 - —Pa k ■ (62) 
J k J-k J-k 
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The detail of this derivation is included in Appendix [TT] The 
duration Tk can be computed in the similar way as <fik in (|32| > 

as 

T k = 2 / dg. (63) 



'Ik 



2E 



v 2 



2V(ji) 



In equations (1601 1 and (1621 . although Tk(t) is open-loop 
control during each stance for t £ [0, Tfc], feedback is achieved 
through and cr^ when switching from one stance to 
another. 

VII. Simulations 

We present simulation results to demonstrate tracking a 
circle centered at the origin with radius 0.02m. The parameters 
for the LLS model are the same as in section [V] The desired 
distance to the circle is 0.03m. Initially, the runner start from 
(0.1,0) outside the circle. The speed of the COM is 0.2m/s. 
The initial direction of the velocity is ir/3. The leg placement 
angle on are constrained to be within the interval (7r/6,7r/3). 
We change the spring constant bk so that qi is always equal 
to 1.53cm, which is 90% of the leg length at rest.The gain Ki 
is selected to be 0.5. When 0i can not be achieved by cdj, we 
simply use the value for ctfj that will minimize the differences 
between desired 0i and achievable 9i\ hence implemented the 
approximation method. 

The trajectory of the COM and the distance between the 
COM and the circle are plotted in Figure [10] We see that the 
convergence is achieved after 12 stances which take less than 
one second. 

VIII. Summary and Future Work 

We have analyzed the control of LLS model and designed 
a hybrid curve tracking control law for legged locomotion. 
Using measurements of the curve for feedback, the discrete 
algorithm guarantees convergence to the desired curve path. 
During each stance, the controlled continuous dynamics is 
analyzed. The parameters of the LLS model is determined 
to implement the discrete algorithm at the beginning of each 
stance. We have also investigated the effects of parameter 
constraints. These constraints limited tracking ability. For 
straight lines and convex curves, a steady state can be reached. 
The robustness of these steady states depends on the range for 
the parameters. 

Interesting results regarding wall following behaviors of 
cockroaches are reported by Camhi and Johnson in [12]. When 
its antenna touches the wall, a cockroach turns away from 
the wall but keeps the antenna in contact with the wall for 
a certain time period. The experiments there are performed 
near a raffled piecewise linear wall, not a smooth curved wall. 
Using a smooth curved wall with convex shape will also be 
interesting since a steady state can be reached. 

Recently, a wall following wheeled robot using antenna like 
tactile sensor was reported in [8]; curve tracking for atomic 
force microscope is discussed in [13]; a general boundary 
tracking control law is derived for Newtonian particles in [14]. 
Our work, although intended for legged locomotion, may be 
adapted to handle other cases regarding curve tracking for 
platforms with hybrid motion dynamics. 




-0.06 -0.04 -0.02 0.02 0.04 0.06 0.08 0.1 
(a) trajectory of COM 




0.5 1 1.5 2 2.5 

(b) distance between COM and the circle 

Fig. 10. Tracking a circle with radius 0.02m. In (a), the cross symbols 
indicate the touchdown points. The units for both horizontal and vertical axis 
are meters. In (b), the distance (in meters) between the COM and the circle 
is plotted as a function of time (in seconds). We can see it converges to the 
desired separation 0.03m. 
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Appendix I 
Discrete dynamics for leg parameters 

The feasible 9k and 9 k +i that can be generated from the 
LLS model parameters must satisfies (|28l l and (|29l l. Equation 
d28t subtract (O yields 



7 fc+l 



h = (Cfc+l - fk+l) - (Cfc - fk) + 

h + <i>k+i 



{ttk + Otk+l) - 



(64) 



The angle (Cfc — (fik) is measured between the COM velocity 
vector and the tangent vector of the desired curve. In a similar 
fashion, we find 

9k+2 — 9k+l = (Cfe+2 — i fk+2) — (Cfc+l — fk+l) — 7r + 
/ , \ | 9k+2 + 4>k+l 

(afc+2 + "fc+i ) H ^ • *^ 65 ^ 

We now establish a difference equation which describes the 
change of (Cfc ~ <Pk)- 

Comparing the COM velocity V/. and v^ +1 , we notice 
that they are reflectively symmetric to each other with q& 
as the axis of symmetry, as shown in Figure [7] This can be 
proved from the solution of equations d26*l >. From Figure [3] we 
conclude that 



fk+i ~fk = 2(- a k ) 



from a right stance to a left stance and 

,7T 4>k+l 



fk+2 — fk+1 



"2( 



otk+i) 



(66) 



(67) 



2 2 

from a left stance to a right stance. From Figure [2] we can 
derive the change of Cfc as 

Cfc+i - Cfc = Ik- (68) 
The angle 7^ can be determined using the sine law 

sin 7^ sin /3 



<7fc Pfc+i + i 
We use P = it/2 — 9k and pk+i = Pk + fk to obtain 



sm7 fc = 



<lk 



A fc + fk 
From d66l l and d68l ). we obtain 



COS t/fc. 



(69) 



(70) 



(Cfc+i - <Pk+i) ~ (Cfc - <Pk) = 7fc - - ^fc - 2afc). (71) 
Similarly, 

(Cfc+2 - fk+2) - (Cfc+l _ fk+l) = 7fc+l + {K— 4>k+l - 2d!fe+l). 

(72) 



Using (TyTT > and d64l i. we deduce that 

''fc+i 



Ok+i - Cfc = -(atk+i - at) - y "'" t " 1 2 + Ik- (73) 
Using (F72b and d65l ). we have 

Vk+2-Vk+i = [otk+2-oik+i)-\ 2 ("7fc+i- (74) 

Equations ( f73l and ( |74"1 i must be satisfied for all feasible 9k, 
9 k +i, and 9 k+2 . 

Appendix II 
Optimal control for rigid body dynamics 

The system equations for the rigid body dynamics is 

Per 

a = T 

Pa = T. (75) 

We want to minimize the cost function J^ k T 2 (t)dt. Applying 
the maximum principle, we define the controlled Hamiltonian 

as 



= Ai — + A 2 r - t 



(76) 



where Ai and A2 are the adjoint variables. The optimal control 
t that minimizes H \ T is computed by letting dH\^ T /dr = 0. 
This yields r = A2/2. The Hamiltonian for the system under 
this control is 

Hx = Al T + \ xl (77) 

This Hamiltonian induces the following Hamilton's equations: 

Va 



Ai = 

A 2 = 



(78) 



From these equations we first observe that Xi(t) = Ai(0). 
Then we can solve for A2 as 



A 2 (t) = A 2 (0)-^i. 
In order to determine Ai(0) and A2(0), we integrate 

A, = 5(^(0)-^*) 



from to Tfc. This yields 



1 



Pa k+1 =p* k + 2 A 2(o)r fe - - — — ± k - 



lAr(0) 2 



1 ( 1 x 1 Ai(0) 2 

P^ + 7 i A 2 (0)t- i ^t 2 



(79) 



(80) 



(81) 



(82) 



We then integrate 

. _ Pa_ = 
a I I 

This gives us 

^fc+i = Ok + \p ak Tk + ^A 2 (0)T fe 2 - J^A x (0)T fc 3 . (83) 

From ( TSTb and d83l we can solve for Ai(0) and A 2 (0). One 
can verify that Ai(0) = A\ k and A2(0) = A 2k , where A% k 
and A 2k are given in (l62l . are the solutions. 



